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ABSTRACT 


A compiler generating system written in the language 
PL360 to run on IBM System/360 computers is presented. The 
concepts and principles of the XPL compiler generating 
system are reviewed. The SLR(k) parsing algorithm is briefly 
described, and an example of SLR(1) parsing is presented. A 
description of the compiler generating system is presented 
along with its limitations, and instructions for its use are 
given. The required PL360 to System/360 interface is de- 
scribed and a listing is included. Program listings and 


sample input and output are included in the appendices. 
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I. IFNEPRODUCTION 


Most computer programs are not written in a machine 
language. Therefore, it is necessary that a program (assem- 
bler, compiler) first translate The input sentences of the 
source program into an appropriate sequence of machine 
instructions before execution can begin. The task of writing 
this program, or translator, is often a long and tedious 
process. Computer Science research and experience with 
existing translators have made it possible for researchers 
to automate major portions of the task. 

Most translators have many tasks in common, such as 
scanning text, analyzing syntax, synthesizing code, and 
interacting with an operating system. It is these tasks 
that are automated by translator writing systems (TWSs). 
Once these tasks are handled, the compiler writer can con- 
centrate on those items unique to his particular translator. 

The objective of the research reported herein was to 
complete the development of a TWS based upon the language 
PL360 [Ref. 1] and to implement the completed TWS at the 
W. R. Church Computer Center, Naval Postgraduate School. 
This goal has been achieved by completion of the proto- 
compiler (a syntax checker without code synthesis facilities, 
@ prototype compiler) originally written by Benched ae 
2] and the development of a PL360 program to analyze a 
grammar and produce the corresponding tables required by the 


SLR(1) [Ref. 3] parsing algorithm. 





The next chapter of this report contains a review of one 
TWS and a description of the SLR(k) parsing algorithm. A 
brief description of the language PL360 is also presented to 
provide the reader with some background information. Chapter 
III contains a description of the completed PL360 compiler 
generating system. The required OS/360 interface is pre- 


sented in Chapter IV. 





II. BACKGROUND 


This chapter first explores the concepts and principles 
of one TWS and then presents a review of the parsing algorithm 
used for the PL360-based TWS. The translator writing system 
reviewed is the XPL system of McKeeman, et al. [Ref. 4]. 
The parsing algorithm, SLR(k), is that chosen by Blanchard 
as the basis for the proto-compiler. An excellent paper by 
Feldman and Gries [Ref. 5] contains a critical review of many 
TWS efforts. Section C contains background information con- 


cerning the language PL360. 


Be THE XPL SYSTEM 

In this section, the principles of McKeeman's compiler 
generator are discussed. The system is explained in detail 
in Ref. 4, which serves both as an introduction to the 
construction of TWSs and as a user's manual for the XPL 
programming language. 

The parsing algorithm used by McKeeman is the mixed- 
strategy (MSP) algorithm, a particular type of bottom-up 
parser, which is a modification of Wirth's [Ref. 6] prec- 
edence concept. The distinguishing feature of the algorithm 
is that it does not use state-of-the-parse information, as 
top-down methods do; rather, it involves examining the 
canonical sentential form (each string in a canonical parse) 
to determine what unique parse step is applicable and then 


performs a substitution. 





The three major programs of the XPL compiler generating 
system are the syntax analyzer which builds the tables 
required by the MSP algorithm, the proto-compiler with which 
the user can produce a compiler, and the XPL compiler which 
translates XPL statements to System/360 machine code. 

The syntax analyzer is a program which accepts the BNF 
definition of a grammar, determines whether the grammer is 
MSP(2,1:1,1) (a special case of MSP), constructs parsing 
decision tables, and punches those tables on cards in the 
form of XPL declarations. 

The proto-compiler uses the cards produced by the analyzer 
and functions as a syntax checker. The user may build on the 
proto-compiler by rewriting ne code synthesis routine to 
implement the semantics of the new language to be compiled 
and by altering the text-scanning routine to process the 
terminal symbols of the new language. During syntax analysis 
each reduction causes the code synthesis procedure to be 
invoked, and the appropriate machine code can be generated. 

ene XPL compiler generating system allows the user to 
construct compilers for languages described by grammars 


wrth a Minimum of effort. 


B. THE SLR(k) PARSING ALGORITHM 

DeRemer defines a class of context-free grammars called 
"Simple LR(k)" or SLR(k) which includes the simple precedence 
grammars as proper subsets. A method for constructing 
parsers for SLR(k) grammars is given in Ref. 9. SLR(k) 


parsers have been implemented by DeRemer and appear to be 





Superior to corresponding MSP parsers both in the speed of 
parser construction and in the size and speed of the resulting 
parsers. 

For the stacking decision, the MSP algorithm uses at most 
the top two symbols on the parse stack and the next symbol 
from the input text. SLR(k) parsers make the stacking de- 
cision based on all the symbols in the parse stack plus k 
more from the input text. This is accomplished by restruc- 
turing the stack and saving state-of-the-parse information. 
The operation of the parser will be illustrated by example. 


Consider a sample grammar: 


Gan: : E 


E::=E+T|o 

= = (E) | x 
The finite state machine represented in Fig. 1 parses 
sentences generated by the sample grammar. The algorithm 
is started in state O and passes through a series of states 
until reaching a state with no successor. The indicated 
rule is applied and the parser is restarted in state O. 
The algorithm terminates upon reaching state 2 and encounter- 
ing an end-of-file mark. For example, when in state 1 and 
the symbol "x" is encountered, apply the reduction T x 
and restart; when in state 3 and the symbol "(" is encoun- 
tered, stack the symbol and enter state 4. 

The SLR(1) parsing algorithm has been implemented in 


Blanchards proto-compiler. 








Fig. 1 Finite State Machine for the Sample Grammar 


Ce PL360 

In 1968, Wirth published a formal description of PL360 
[Ref. 1], a language designed specifically for the IBM 
System/360. A year later, a compiler for PL360 was written 
by Wirth, J. W. Wells, Jr., and E. Satterthwaite, Jr. and 
made available through the IBM Contributed Program Library 
Peet. 7). severe amendments to the original language 
definition were included with the documentation issued with 
the compiler. Further extensions and modifications to the 
language have recently been carried out, most notably by 
M. A. Malcolm [Ref. 8]. Malcolm's PL360.manual has in- 
corporated all changes to the language definition and com- 
piler description to date. 

PL360 is a language that provides most of the facilities 
provided by System/360 Assembler Language yet exhibits a 


block-structured, ALGOL-like syntax. It was designed to 
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improve the readability of programs which take advantage of 
features unique to the System/360. The PL360 language is 
defined by a set of BNF rules and semantic explanations 


given in Ref. 8. 
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IIL. DESCRIPTION OF THE PL360 COMPILER GENERATING SYSTEM 


This chapter describes the completed compiler generating 
system that was begun by Blanchard. To complete the system 
it was necessary to: 

i. Implement in PL360 a syntax analyzer that would 
provide the necessary SLR(1) parsing tables re- 
quired for the proto-compiler. 

2. Make several changes to the proto-compiler to make 


he mere. versatile. 


A. THE SYNTAX ANALYZER 
i Description Of thevsyntax Analyzer 

The program called SLRIANAL is the grammar analyzer 
of the compiler generating system. A program listing is 
contained in Appendix A. It is patterned after DeRemer's 
Simple LR(1) grammar analyzer that was written in XPL and 
has the same function and basic structure. 

SLRIANAL constructs a Characteristic Finite State 
Machine for a grammar and produces the SLR(1) parsing tables 
that are required by the proto-compiler. Appendix B con- 
tains a listing of a sample input grammar. The output 
of the SLR(1) parsing tables is in the form of punched 
PL360 declarations. Appendix C contains a complete listing 


of the SLRIANAL output for the input shown in Appendix B. 


eZ 





The program can be divided into 7 basic parts: 


a 


The data area which contains 9 PL360 data 
segments that contain the numerous arrays that 
are required. 

The procedure READG that reads the input BNF 
description of a grammar, sorts the grammar, 
finds the goal symbol of the grammar and prints 
the grammar in standard BNF format. 

The procedure COMPUTECFSM that computes and 
outputs the Characteristic Finite State Machine. 
The procedure LOOKAHEAD that computes and outputs, 
if necessary, the required look-ahead sets for 
the SLR(1) parser. 

The procedure COMPUTEDPDA that computes and out- 
puts the look-back states and sets the successors 
of the reduce states. 

The procedure PUNCHDPDA that prints and punches 
the declarations required for the proto-compiler. 
The main program that controls the logical flow 


of the computation. 


How to Use the Syntax Analyzer 


Input to SLRIANAL is made by cards containing BNF 


productions which are placed one to a card by using the 
following conventions: if the first column is non-blank, the 
first token is taken to be the left part of the production; 
otherwise, the left part is assumed to be the same as the 


left part of the preceding production. The balance of the 


IEE 





@ard is taken to be the rightepart of thespreductions WAny 
token that does not occur as a left part is a terminal 
symbol. Any token that occurs only as a left part is taken 
to be the goal symbol for the grammar. All productions 
with the same left part must be grouped together. If the 
user wishes to recognize identifiers and/or numbers he 
should include as terminal symbols <IDENTIFIER? and 
<4NUMBER>, respectively. The proto-compiler has mechanisms 
to recognize these symbols and take the necessary actions. 
Input cards with the character "@" in the first 
column are treated as comment or control cards as listed 
below. It is possible to batch grammars together by 
separating the grammars by control cards beginning with 
"@EOG". Such a card should not be included after the last 
grammar. The SLRIANAL control cards are as follows: 
a. @I is a toggle controlling the listing of the 
input data cards *Gnitiallyeecr). 
b. @G is a toggle controlling the listing of the 
reformatted grammar (initially on). 
¢. @C is a toggle controlling the lieting of the 
Series Sheeran sets (initially off). 
d. @F is a toggle controlling the listing of the 
CESM (initially en). 
e. @L is a toggle controlling the listing of the 
look-ahead sets (initially on). 
£. @€b is a toggle controlling the lasting of the 


DPDA (initially on). 
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g.- €P is a toggle controlling the Sunching ceecne 
parsing tabllesM(initialibworar 
h. @EOG separates batched grammars. 
Liu WL othe cards containing "@" in column one are 
taken as comment cards. 
The job control language required to execute 
SLRIANAL can be found in Appendix G. 
3. Limitations of the oo can ees 
SLRIANAL reads a grammar and attempts to construct 
an SLR(1) parser for it. The program either succeeds and 
punches tables that represent the parser, or it prints 
messages stating the reasons why it cannot. If the program 
fails, the given grammar is either too large in some aspect 
Gr Ht is not SLR(1); i. e., the program will suceed, except 
for space limitation, for any SLR(1) grammar. The one 
limitation most notable is that the BNF description of an 


input grammar cannot exceed 250 productions. 


Pee tHe PROTO-COMPILER 
a. Description of the Proto-Compiler 

The program called "PROTOCOM" forms the basis of 
the PL360 compiler generator system. A listing of PROTOCOM 
is given in Appendix D. It is patterned after McKeeman's 
proto-compiler and has the same function and basic structure. 

PROTOCOM uses the SLR(1) parsing tables obtained 
from SLRIANAL. The tables are referenced by the algorithm 
contained in the procedure ANALYZE to implement the finite 


state machine of a grammar. 


ibs) 





ANALYZE calls on procedure PUSHANDREAD or procedure 
SYNTHESIZE based on a decision to stack the current symbol 
and read a new one or to make a reduction and perform the 
required semantic operations. Since code synthesis is not 
a function of PROTOCOM, SYNTHESIZE exists only to maintain 
flow of control and indicate that its presence would be 
required in a full-scale compiler. 

Procedure SCAN, called from either PUSHANDREAD or 
ANALYZE, interprets characters in the card buffer. Upon 
reaching the end of a card image, a call on procedure GETCARD 
causes a new card to be read. 

The only other major procedure is ERROR which is 
called from a number of other routines. It handles syntax 
errors and prints diagnostic messages. 

PROTOCOM as implemented by Blanchard would accept 
as terminal symbols only those consisting of one character, 
with the possibility of future expansion to eight characters. 
One other limitation was the data area available for the 
parser tables. The mechanisms causing these limitations 
were changed to allow the proto-compiler to be useful for 
large grammars. PROTOCOM will now recognize all symbols of 
64 characters or less, and the data area available for the 
parsing tables is limited only by the space available in 
the user's System/360 region. 

2. How to Use the Proto-Compiler 
The first step in using PROTOCOM is to place the 


punched declarations from SLRIANAL into the beginning 
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of PROTOCOM. They must be placed after the comment "THE 
FOLLOWING CARDS WERE PUNCHED BY THE SLR(1) SYNTAX ANALYZER" 
and before the comment "END OF CARDS PUNCHED BY SLR(1) 

SYNTAX ANALYZER." The cards that are already present between 
the two comments must be removed. 

Input to PROTOCOM is a program written in the 
language defined by the grammar. PROTOCOM will parse the 
input program. If it detects any conflicts between the 
input program and the SLR(1) parsing tables, it will out- 
put an appropriate error message along with a partial parse. 
If no errors are found, the only output is a listing of the 
input program and the message "END OF COMPILATION." A 
listing of a sample output is located in Appendix E. 

The job control language required to execute PROTOCOM 
is given in Appendix G. 

3. Limitations of the Proto-Compiler 

PROTOCOM appears to have no limitation as a syntax 
Checker. If the user wishes to use PROTOCOM as the basis 
for a compiler, he must write the procedures SYNTHESIZE and 
EMIT. These procedures are necessary to generate the machine 
code necessary to execute the program. At present PROTOCOM 
does not build any symbol tables. Therefore, the user must 
also write the procedure LOOKUP to enter and look up symbols 


in the symbol table. 
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IV. OPERATING SYSTEM INTERFACE 


Since PL360 object modules do not communicate directly 
with an operating system, an seeestiea ce program must be 
provided that can be compiled separately and linked to the 
PL360 object module by Ke linkage editor or linking loader. 

A program called "PLIO" is presently being used as the 
interface between the PL360 object modules and OS/360. A 
listing of PLIO can be found in Appendix F. The current 
interface contains 4 subroutines which facilitate input 
and output operations. In addition to these 4 subroutines, 
2 more subroutines need to be added to PLIO if PROTOCOM is 
to be used as a compiler. The first subroutine would de- 
code any required parameter list, open required data sets, 
obtain free storage, and supply system identification. The 
second would release free storage and close the required 
data sets. 

The subroutines presently in PLIO are listed below with 
their names and specifications. 

A. READ: Read an 80 character record from the input 
data set and store it in the 80-byte area 
designated by the address contained in RO. 
If an end-of-file is encountered, then set 
the condition code to 2, else set it to 0. 

B. WRITE: Write a 132 bype record from the memory 
location designated by the address contained 


in RO to the output data set. 
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ce. 


D. 


PAGE: Causes the next output record to contain the 


USASTI control character "1" to be placed 


into the first position of the next output 


record. 


PUNCH: Write the 80-byte record whose address is 


contained in RQ to the punch output data set. 


PLIO uses the following input and output data sets, 


which are identified by their DDNAMES. All data sets are 


sequential with fixed block format. 


A. 


B. 


c. 


oWwoLN : 


SYSOUT: 


SYSPUNCH: 


This data set contains the input and is 
referenced by the READ subroutine. The 
data set consist of compiler instructions 
and one or more source programs. 

This data set contains output originating 
with the subroutine WRITE and any compiler 
diagnostic messages. The logical record 
length is 133 bytes. 


This data set contains output originating 


‘with the subroutine PUNCH. The logical 


record is 80 bytes. 


If PROTOCOM is used aS a compiler then one data set with 


a logical record length of 80 bytes and closed with a 


disposition of REREAD would be required to contain object 


module output. 


The data set SYSPUNCH could be used for this 


purpose and passed to the following step (i.e., LINK). 


i 





V. CONCLUSIONS 


The PL360 language is well suited to form the basis of a 
compiler generating system which is to be implemented on the 
IBM System/360._ It is fairly successful in providing a tool 
which is superior to assembly code and in meeting the ob- 
jectives of readability and writability. The language is 
not as easy to use as some other high-level compiler-writing 
languages, such as XPL. The execution speed, however, 
indicates that it may be the superior language in systems 
and production programming applications. 

To make the compiler generating system useful, rigorous 
debugging of the system should be done. The aforementioned 
procedures in PROTOCOM , EMIT and LOOKUP, need to be written, 
along with the nucleus of the procedure SYNTHESIZE. A 
completely documented and explanatory users' manual is needed 
to make the system easier to use. It is recommended that 
these projects be undertaken to make the system a truly use- 


ful compiler generating system. 
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JOB CONTROL LANGUAGE 
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